What Are They Thinking? Automated Analysis of Student Writing about Acid–Base Chemistry in Introductory Biology

نویسندگان

  • Kevin C. Haudek
  • Luanna B. Prevost
  • Rosa A. Moscarella
  • John Merrill
  • Mark Urban-Lurain
چکیده

Students' writing can provide better insight into their thinking than can multiple-choice questions. However, resource constraints often prevent faculty from using writing assessments in large undergraduate science courses. We investigated the use of computer software to analyze student writing and to uncover student ideas about chemistry in an introductory biology course. Students were asked to predict acid-base behavior of biological functional groups and to explain their answers. Student explanations were rated by two independent raters. Responses were also analyzed using SPSS Text Analysis for Surveys and a custom library of science-related terms and lexical categories relevant to the assessment item. These analyses revealed conceptual connections made by students, student difficulties explaining these topics, and the heterogeneity of student ideas. We validated the lexical analysis by correlating student interviews with the lexical analysis. We used discriminant analysis to create classification functions that identified seven key lexical categories that predict expert scoring (interrater reliability with experts = 0.899). This study suggests that computerized lexical analysis may be useful for automatically categorizing large numbers of student open-ended responses. Lexical analysis provides instructors unique insights into student thinking and a whole-class perspective that are difficult to obtain from multiple-choice questions or reading individual responses.

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Context Dependence of Students’ Views about the Role of Equations in Understanding Biology

Students' epistemological views about biology--their ideas about what "counts" as learning and understanding biology--play a role in how they approach their courses and respond to reforms. As introductory biology courses incorporate more physics and quantitative reasoning, student attitudes about the role of equations in biology become especially relevant. However, as documented in research in ...

متن کامل

Conceptual Models of Structure and Function

A student studying introductory biology at the college level faces the challenges of both mastering a large new vocabulary and integrating diverse, core concepts across different levels of biological organization. This task is made even more difficult due to the metaphoric language that is typical of introductory biology textbooks. In this paper, we report our achievements in creating conceptua...

متن کامل

Student Reflection and Critical Thinking: A Rhetorical Analysis of 88 Portfolio Cover Letters

This research is an analysis of88 first-year portfolio cover letters from the Spring 2000 English 102 Program Assessment at the University of Nevada, Reno. This analysis focuses on what these students viewed as the rhetorical purposes of cover letters. The goal of this study was to apply the theories of Aristotle, Toulmin, and Burke to these letters to analyze their appellate, argumentative, an...

متن کامل

Writing Assignments with a Metacognitive Component Enhance Learning in a Large Introductory Biology Course

Writing assignments, including note taking and written recall, should enhance retention of knowledge, whereas analytical writing tasks with metacognitive aspects should enhance higher-order thinking. In this study, we assessed how certain writing-intensive "interventions," such as written exam corrections and peer-reviewed writing assignments using Calibrated Peer Review and including a metacog...

متن کامل

Assessing Critical Thinking Ability via the Writing Process: Developing and implementing a Rating Scale

The present exploratory mixed methods study aimedto develop a scale for assessing critical thinking (CT) ability of Iranian EFL learners. The study wasconducted in three phases. In phase one, the features of CT components were examined in the writingsof 120 participants. A holistic and an analytic scale were developed based on their performance in exploiting the components of CT and the fea...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

عنوان ژورنال:

دوره 11  شماره 

صفحات  -

تاریخ انتشار 2012